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(57) Abstract: The present invention relates to a system 
of modeling a three dimensional target object which 
is represented by a plurality of cross-sectional images 
in order to provide a representative corresponding three 
dimensional model. The invention selects an initial 
model from a plurality of available initial models. This 
selection involves identifying an initial model based 
on physical similarity to the target object and then 
superimposing an initial model upon the target object, 
for each of the plurality of cross-sectional images. A 
determination is then made of an intersection contour 
of the initial model and a cross-sectional image of the 
target object and the determined intersection contour 
is refined in order to more closely delineate the target 
object By sub-sampling points which represent the 
refined determined intersection contour, the invention 
obtains a sub-sampled contour dataset. The initial 
model is then adjusted towards the sub-samples contour 
to obtain a representative three dimensional model of 
the target object. 
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A SYSTEM FOR MODELING STATIC AND DYNAMIC THREE DIMENSIONAL 
ANATOMICAL STRUCTURES BY 3-D MODELS 

BACKGROUND OF THE INVENTION: 

1. Field of the Invention 

The present invention relates to the computer modeling of a potentially dynamic 
anatomical structure in a given image volume(s). This allows for the measurement of the 
geometry of the underlying object at a specific point in time or over a set of time periods. 

2. Description of Related Art: 

Temporal variation in organ morphology is frequently of interest to physicians and 
surgeons. In the heart, for example, the change in blood pool volume of the left ventricle over 
the cardiac cycle is used to diagnose dysfunction and determine a course of treatment. 
Similarly, differential lung capacity is an effective determinant for assessing pulmonary 
disease. In the brain, swelling in response to injury may be tracked over a period of time to 
provide an indicator of severity of trauma. In another example, disease progression such as 
cirrhosis is reflected in the shape evolution of the liver. Indeed, the history of tumor volume 
is a value scrutinized closely by doctors. 

A method for segmenting objects from 3D images using a 3D deformable surface 
which was made up of a series of 2D planar curves is proposed. However, this model is not 
cohesive in terms of being 3-D and is more a propagation of 2-D contours in space followed 
by a stitching together of the contours. In addition, the 2D planar curves are not recovered 
via optimal active contours ("optimal" meaning that the energy function describing the 
contour is globally minimized). Instead the proposed method employs snakes and relies on 
balloon forces to explore crevices. The problem with balloon forces is that the snake might 
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leak where the image boundaries are not well defined. 2D deformable surfaces have also 
been applied to segmentation but the approaches have not been "optimal". For ID contours, 
optimality is a well understood concept. How this concept might be extended to 2D surfaces 
still presents difficulty. 

Direct application of 3D models to 3D image volumes has also met with mixed 
success. Again, describing deep crevices becomes a problem. Some proposed methods fit 
parallel sets of 2D contours to recover a 3D object. Once the fit is settled the methods repeat 
the process from an orthogonal direction using the results of the previous iteration as a 
starting point. However, these methods employ balloon forces to fit the 2Dcontours and their 
result is not a coherent 3-D surface model. In addition, these methods are applied on 
relatively simple synthetic shapes. Region growing techniques are also used for 
segmentation. However, while these techniques are often effective they suffer from bleeding 
in areas where the object boundary is not well defined. In addition, these techniques do not 
result in a geometric description of the object, rather they result in a collection of voxels. A 
voxel is a unit of graphic information that defines a point in three dimensional space (in other 
words, a volume pixel). 

Segmentation via the propagation of 2D active contours (i.e., using the result from a 
previous slice as the starting point for a segmentation of the current slice) is problematic. A 
change in an object's circumference in a slice might be due to a change in the radius of the 
object under recovery, or it might be due to a change in direction of the path taken by the 
object in space. Determining if a change in circumference or direction has occurred is 
essential for selecting an appropriate starting point for segmentation in the slices to follow. 
Two-dimensional active contours lack the global properties necessary to account for these 
instances. 

3-D models are powerful tools. They can provide detailed description of an object. It 
is difficult, however, to directly employ 3-D models in the segmentation process since they 
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are not guaranteed to locate the optimal boundaries in cross-sectional slices. Propagating 2D 
active contours from slice to slice, on the other hand, to delineate an object's boundaries is 
effective but encounters problems when an object's shape dramatically changes such as in 
areas of high curvature. 

A cooperative framework to exploit the positive aspects of both 3D model and 2D 
active contour approaches for segmentation and recovery is advantageous. In this framework, 
a default model shape, positioned in the data would provide starting points for a set of 2D 
segmentations (refinements) performed by active contours. The same model is fitted to the 
results of the segmentation. 

Therefore, a need exists for a general cooperative approach for segmenting objects 
from 3D image volumes which exploits the positive aspects of both 2D and 3D traditional 
approaches. 

SUMMARY OF THE INVENTION 

The present invention relates to a system of modeling a three dimensional target 
object which is represented by a plurality of cross-sectional images in order to provide a 
representative corresponding three dimensional model. The invention selects an initial model 
from a plurality of available initial models. This selection involves identifying an initial 
model based on physical similarity to the target object and then superimposing an initial 
model upon the target object, for each of the plurality of cross-sectional images. A 
determination is then made of an intersection contour of the initial model and a cross- 
sectional image of the target object and the determined intersection contour is refined in order 
to more closely delineate the target object. By sub-sampling points which represent the 
refined determined intersection contour, the invention obtains a sub-sampled contour dataset. 
The initial model is then, adjusted towards the sub-samples contour to obtain a representative 
three dimensional model of the target object. 
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BRIEF DESCRIPTION OF DRAWINGS 

The invention is described in detail in the following description of preferred 
embodiments with reference to the following figures wherein: 

FIG. 1 is a flow diagram showing method steps and three stages of the present 
invention; 

FIG. 2 is a flow diagram showing in further detail the steps of Stage 1 of FIG. 1; 

FIG. 3 is a flow diagram showing in further detail the steps of Stage 2 of FIG. 1; 

FIG. 4 is a flow diagram showing in further detail the steps of Stage 3 of FIG. 1 ; 

FIG. 5 is a perspective view of a portion of a hybrid model showing a parametric 
component and a local component; 

FIG 6 shows the user selecting points on two orthogonal images to initially position 
the parametric component of the model; 

FIG 7 illustrates the technique for refining the contours segmentation; 

FIG 8 shows the intersection of one image axis with the parametric component of the 
hybrid model. This intersection forms the starting point for a 2-D segmentation. The result of 
the segmentation is also shown; 

FIG 9 shows the same process as FIG 9 but for a different (orthogonal) axis; and 

FIG 10 shows the contours resulting from the 2-D segmentations in space and the 
hybrid model fit to them. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

In the present system a method comprises quantifying the change in organ 
morphology using a semi-automatic segmentation method. A user approximately positions a 
model of the organ (or organs) in an image volume. After this, the process is fully automatic. 
Steps include intersecting the user-positioned model with the individual image planes of the 
volume to create a series of contours approximating the position of the underlying organ. 
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Then, optimal 2-D segmentation algorithms are used to refine the boundary of the organ 
using the approximate contours as starting points. From these optimal contours a new model 
is applied. Volume and other morphometric measurements are then taken on the model. It is 
to be noted that in an alternative embodiment a model may be automatically positioned in an 
image volume. 

For the case of recovering the left ventricle (LV) of the heart, for each stage of the 
cardiac cycle the following steps are taken: First, the approximate position of the LV is 
specified by the user. The approximate inner and outer boundaries are outlined with a series 
mouse clicks on both a short axis image as well as a long axis image, the model is 
automatically fit to these points. The resulting model is referred to as the initial model. Note 
that this model is not required to sit exactly on the boundary of the organ. It is enough that it 
is close to the boundary of the organ. Further, the initial model is intersected with each of the 
image planes in the image volume. The result is a series of contours (inner and outer) in each 
of the cross-sectional images of the volume. These individual contours form starting points 
for optimal 2-D segmentations of the LV. A new model (or the initial one) is automatically 
fit to these recovered contours. This procedure is then repeated for every temporal instance. 

A cooperative framework includes a method for combining three dimensional (3D) 
models with two dimensional (2D) segmentations. In one example/a user initializes a 
parametric component of a hybrid model. A hybrid model is a parametric model with a 
spline-like mesh on its surface which is capable of deforming to describe fine detail in an 
image volume. Intersections of image slices with the parametric component serve as starting 
points for a segmentation of the object boundaries using active contours. The resulting 
segmentations are sampled to create a data set of 3D points to which the original hybrid 
model is fit. The hybrid model is free to deform both parametrically and locally in order to 
represent the object of interest. In this way, the user initializes the hybrid model, the hybrid 
model initializes the 2D active contours, and the active contours constrain the fit of the hybrid 
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model. This fit is referred to as a physically motivated fit. The process may then be repeated 
for different time instances. 

Referring to FIGS. 1-10 of the present invention and in particular to FIG. 1 which 
provides a flow chart of the method of the present invention. As described above, block 100 
of FIG. 1 represents an initialization of the model . This includes taking a volumetric image 
of an object to be modeled. The intersection of the models with the imaging planes results in 
an approximation to the cross-section of the object in the image. This approximation serves 
as a starting point for active contour segmentations in the image, in block 105. In block 110, 
segmentation using active contours is performed on the object in the image. The segmented 
contours are used to create a data set of 3D points in block 120. In block 130, the model is 
fit to the data points of block 120 to represent the object. This process is repeated for 
subsequent time instances as shown in block 131. 

Referring to FIG. 2 of the drawings, a detailed flow chart is provided for block 100 
initializing the model. This step includes identifying approximate positions on the surface 
from at least two views which bounds the extremities of the object. In the case of the left 
ventricle of the heart both inner and outer walls (endocardial and epicardial) must be 
delineated. The approximate positions of the points on the surface of the object are identified 
in blocks 102 and 106, The orthogonal cross section is identified in block 104. If necessary 
this step is repeated after the step in block 106. A parametric component of the model is then 
fitted to the points as shown in block 108. 

Referring to FIG. 3 of the drawings, in block 111, the initial model image and, the 
image planes intersect. FIG. 3 of the drawings illustrates, block 105 of FIG. 1 in a detailed 
flowchart, in a preferred embodiment a two dimensional image is represented as a graph in 
block 112. These intersections are used as the starting points for 2D segmentation. The edge 
cost is found between graph nodes using image gradients in block 114. A search space is 
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defined around the approximate input contour in block 1 16. A path of lowest energy between 
pixels/nodes is determined using Dijkstra's algorithm in block 118. Dijkstra's algorithm is a 
standard graph algorithm and can be found in any algorithm's book such as C.G. Brassard 
and P. Bratley, Algorithmics: Theory and Practice, Prentice Hall, 1988. This step is 
repeated for a different search space if the resulting contour is not closed in block 122. By 
determining the lowest energy path a contour (path) is defined in block 124. 

FIG. 4 of the drawings is a detailed flow chart of block 110 of FIG.l illustrating 
fitting the model of block 130. This fitting of the model includes determining data and 
smoothing forces for the points of the data set in block 132. The data and smoothing forces 
are scaled in block 134. Shape functions that reduce the number of iterations needed to fit the 
model to the data are applied to finite element model (FEM) elements in block 136. An 
(FEM) is a finite element model which is made up of a finite number of elements on the 
surface of the model and serve to describe the model. Data and smoothing forces are 
combined in block 138. Applying the adjusted forces to the hybrid model to deform the 
hybrid model is performed in block 140. 

Segmentation is among the most widely researched topics in computer vision. A 
comparison of the cooperative framework described in this disclosure is compared with the 
most closely related work. However, the method as described is applicable to other 
techniques and systems. 

A preferred embodiment of a hybrid 3-D model for the heart left ventricle is described 
in the following. It is understood that this invention is not restricted to this model only. The 
invention applies to any model of any object. The approach may make use of any 3D model 
form. In the present example the hybrid model is chosen. Referring to FIG. 5, for the use of a 
hybrid model of the LV, the model formulation is hybrid in that it is made up of a parametric 
component 20 and a local, spline-like mesh component 22 over the parametric component. 
This local component may deform away from the parametric surface to describe fine detail. 
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The parametric component of the model is based on two ellipsoids, one describing the inner 
wall of the LV and one describing the outer wall. The model has an underlying parametric 
component which resembles a double hulled ellipsoid (one for the inner wall of the left 
ventricle and one for the outer wall). The model is broken up into octants which are described 
by their own parametric formulations. The quadrants are called PosPosPos, NegPosPos, 
NegNegPos, PosNegPos, PosPosNeg, NegPosNeg, NegNegNeg, PosNegNeg with 
representations for the inner and outer walls. This parametric representation is swept out by 
two intrinsic spherical coordinates, u and v. 

The extrinsic parameters of alPosInner alPosOuter rPosPosInner rPosPosOuter 
a2PosInner a2PosOuter rNegPosInner rNegPosOuter alNeglnner alNegOuter rNegNeglnner 
rNegNegOuter a2NegInner a2NegOuter rPosNeglnner rPosNegOuter a3PosInner describe 
the general shape of the double hulled ellipsoid. 

PosPosPosInner: 

X = alpha 

Cos[u] (alPosInner Cos[v] + rPosPosInner Sin[2 v] ); 

Y = alpha Cos[u] Sin[v] (a2PosInner + rPosPosInner Sin[v] + rPosPosInner 
Sin[3v]); 

Z = a3PosInner alpha Sin[u]; 
NegPosPosInner: 

X = alpha Cos[u] Cos[v] (alNeglnner - rNegPosInner Cos[v] + rNegPosInner 
Cos[3 v]); 

Y = alpha Cos[u] Sin[v] (a2PosInner + rNegPosInner Sin[v] + rNegPosInner 
Sin[3v]); 

Z = a3PosInner alpha Sin[u]; 



WO 02/093494 



-9- 



PCT/US02/14634 



NegNegPosInner: 

X = alpha Cos[u] Cos[v] (alNeglnner - rNegNeglnner Cos[v] + rNegNeglnner 
Cos[3 v]); 

Y = -(alpha Cos[u] Sin[v] (-a2NegInner + rNegNeglnner Sin[v] + rNegNeglnn. 
Sin[3 v])); 

Z = a3PosInner alpha Sin[u]; 
PosNegPosInner: 

X = -(alpha Cos[u] Cos[v] (-alPosInner - rPosNeglnner Cos[v] + rPosNeglnner 
Cos[3v])); 

Y = -(alpha Cos[u] Sin[v] (-a2NegInner + rPosNeglnner Sin[v] + rPosNeglnner 
Sin[3 v])); 

Z = a3Poslhner alpha Sin[u]; 
PosPosNeglnner: 

X = alpha Cosfu] (1 + alpha tapxPosInner Sin[u]) 
(alPosInner Cos[v] + rPosPoshmer Sin[2 v] ); 

Y = alpha Cos[u] (1 + alpha tapyPosInner Sin[u]) Sin[v] (a2Pos!nner + 
rPosPosInner Sin[v] + rPosPosInner Sin[3 v]); 

Z = a3NegInner alpha Sin[u]; 

NegPosNeglnner: 

X = alpha Cos[u] Cos[v] (alNeglnner - rNegPosInner Cos[v] + rNegPosInner 
Cos[3 v]) (1 + alpha tapxNeglnner Sin[u]); 

Y = alpha Cos[u] (1 + alpha tapyNeglnner Sin[u]) Sin[v] (a2PosInner 4- 
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rNegPosInner Sin[v] + rNegPosInner Sin[3 v]); 
Z = a3NegInner alpha Sin[u]; 

NegNegNeglnner: 

X = alpha Cos[u] Cos[v] (alNeglnner - rNegNeglnner Cos[v] + rNegNeglnner 
Cos[3 v]) (1 + alpha tapxNeglnner Sin[u]); 

Y = -(alpha Cos[u] (1 + alpha tapyNeglnner Sin[u]) Sin[v] (-a2NegInner + 
rNegNeglnner Sin[v] + rNegNeglnner Sin[3 v])); 

Z = a3NegInner alpha Sin[u]; 

PosNegNeglnner: 

X = -(alpha Cos[u] Cos[v] (-alPosInner - rPosNeglnner Cos[v] + rPosNeglnner 
Cos[3 v]) (1 + alpha tapxPosInner Sin[u])); 

Y = -(alpha Cos[u] (1 -I- alpha tapyPosInner Sin[u]) Sin[v] (-a2NegInner + 
rPosNeglnner Sin[v] + rPosNeglnner Sin[3 v])); 

Z = a3NegInner alpha Sin[u]; 

PosPosPosOuter: 
2n X = alpha 

Cos[u] (alPosOuter Cos[v] + rPosPosOuter Sin[2 v] ); 

Y = alpha Cos[u] Sin[v] (a2PosOuter + rPosPosOuter Sin[v] + rPosPosOuter 
Sin[3 v]); 

Z = a3PosOuter alpha Sin[u]; 
NegPosPosOuter: 

X = alpha Cos[u] Cos[v] (alNegOuter - rNegPosOuter Cos[v] + rNegPosOuter 
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Cos[3 v]); 

Y = alpha Cos[u] Sin[v] (a2PosOuter + rNegPosOuter Sin[v] + rNegPosOuter 
Sin[3v]); 

Z = a3PosOuter alpha Sin[u]; 
NegNegPosOuter: 

X = alpha Cos[u] Cos[v] (alNegOuter - rNegNegOuter Cos[v] + rNegNegOuter 
Cos[3 v]); 

Y = -(alpha Cos[u] Sin[v] (-a2NegOuter + rNegNegOuter Sin[v] + rNegNegOuter 
Sin[3 v])); 

Z = a3PosOuter alpha Sin[u]; 
PosNegPosOuter: 

X = -(alpha Cos[u] Cos[v] (-alPosOuter - rPosNegOuter Cos[v] + rPosNegOuter 
Cos[3 v])); 

Y = -(alpha Cos[u] Sin[v] (-a2NegOuter + rPosNegOuter Sinfv] + rPosNegOuter 
Sin[3v])); 

Z = a3PosOuter alpha Sin[u] ; 
PosPosNegOuter: 

X = alpha Cos[u] (1 + alpha tapxPosOuter Sin[u]) 
(alPosOuter Cos[v] + rPosPosOuter Sin[2 v] ); 

Y = alpha Cos[u] (1 + alpha tapyPosOuter Sin[u]) Sin[v] (a2PosOuter + 
rPosPosOuter Sinfv] + rPosPosOuter Sin[3 v]); 

Z = a3NegOuter alpha Sin[u]; 
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NegPosNegOuter: 

X = alpha Cos[u] Cos[v] (alNegOuter - rNegPosOuter Cos[v] + rNegPosOuter 
Cos[3 v]) (1 + alpha tapxNegOuter Sin[u]); 

Y = alpha Cos[u] (1 + alpha tapyNegOuter Sin[u]) Sin[v] (a2PosOuter + 
rNegPosOuter Sin[v] + rNegPosOuter Sin[3 v]); 

Z = a3NegOuter alpha Sin[u] ; 

NegNegNegOuter: 

X = alpha Cos[u] Cos[v] (alNegOuter - rNegNegOuter Cos[v] + rNegNegOuter 
Cos[3 v]) (1 + alpha tapxNegOuter Sin[u]); 

Y = -(alpha Cos[u] (1 + alpha tapyNegOuter Sin[u]) Sin[v] (-a2NegOuter + 
rNegNegOuter Sin[v] + rNegNegOuter Sin[3 v])); 

Z = a3NegOuter alpha Sin[u]; 

PosNegNegOuter: 

X = -(alpha Cos[u] Cos[v] (-alPosOuter - rPosNegOuter Cos[v] + rPosNegOuter 
Cos[3 v]) (1 + alpha tapxPosOuter Sin[u])); 

Y = -(alpha Cos[u] (1 + alpha tapyPosOuter Sin[u]) Sin[v] (-a2NegOuter + 
rPosNegOuter Sin[v] + rPosNegOuter Sin[3 v])); 

Z = a3NegOuter alpha Sin[u]; 

Stage 1 : User Initialization 

-. ■ ' ■ 

In this stage, the user provides an approximation to the object of interest by 
approximately fitting the model to the data. The method for doing this depends on the 
topology of the object and the form of the parametric component. Here, a method for a left 
ventricle is described. Note that the approximation may be quite rough as the segmentation 
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routine (Stage 2) will discover the exact object boundaries. In order for the segmentation 
routine to be effective, the initial model must be reasonably close, within 10 pixels for 
example. 

The user defines points on the approximate border of the both the inner and outer 
(endocardial and epicardial) walls of the left ventricle for a cross-section. Then, in order to 
specify the general bounds of the shape, the user repeats this action on an orthogonal image. 
For the LV, these would be the short axis and long axis images. (FIG 6). 

Stage 2: 2 D Optimal Active Contour Segmentation 

The task of refining the contours is also known as segmentation. Here the 
segmentation module is described. It is given two approximate contours (endocardium and 
epicardium) from the previous step. These contours, however, do not exactly delineate the 
features in the image. The present invention seeks to refine the contours so that the 
endocardium exactly delineates the border between the myocardium and the blood pool, and 
the epicardium exactly delineates the border between the myocardium and the outside. See 
FIG. 7. 

FIGS. 8 and 9 also describe refining the contours following intersection of the model 
with the image from the approximate contour (150) to the recovered contour (160) as 
illustrated in FIG. 9. 

The way to do this is to use active contours (snakes). Snakes were first proposed by 
Kass et al (M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active contour models", 
InternationalJournal of Computer Vision, 2:321-331, 1988) are defined as contours that are 
pushed or pulled towards image features by constraining forces. An energy function based on 
the smoothness and curvature of the contours and the edge strength in the image along the 
contour. This energy function is to be minimized. Kass et al Proposed to minimize the 
energy function using gradient descent. Amini et al (A. A. Amini, T. E. Wemouth, and R. C. 
Jain, "Using dynamic programming for solving variational problems in vision", IEEE Trans. 
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Pattern Analysis and Machine Intelligence, 12(9):855-867, 1990) used dynamic 
programming. 

The present invention uses an algorithm similar to Geiger et al (D. Geiger, A. Gupta, 
L. A. Costa, and J. Vlontzos, "Dynamic programming for detecting, tracking, and matching 
deformable contours", IEEE Trans. Pattern Analysis and Machine Intelligence, 17(3):294- 
302, 1995), but using Dijktra's graph search algorithm as in Mortensen and Barrett (E. N. 
Mortensen and W. A. Barrett, "Interactive segmentation with intelligent scissors", Graphical 
Models and Image Processing, 60:349-384, 1998). 

Dijkstra's algorithm is a standard graph theory algorithm and can be found in any 
algorithm's book such as (G. Brassard and P. Bratley, Algorithmics: Theory & Practice, 
Prentice Hall, 1988). The present system involves creating a graph by defining a node for 
every pixel in the image. Nodes that correspond to neighboring pixels are connected by a link 
whose weight is inversely proportional to the gradient in the image between the 
corresponding pixels. Then, given a source node, Dijkstra's algorithm is able to find the 
minimum path between the source node and all nodes in a set of sink nodes. Since the cost of 
a path is the sum of the cost of the links it goes through, the minimum path corresponds to the 
contour with maximum gradient. If one is not sure on the starting point, then one can define a 
set of source nodes and connect all of them to a "pseudo" source node with a zero cost link. 

Reference is made to the illustrative steps of the algorithm with an example (see FIG. 
7). Block 200 shows an image of the left ventricle in a short axis cross section and an 
.approximate contour for the endocardium. 

In the first step the method of the present system defines a search space of a given 
width (say 10 pixels) around the approximate contour 202(a). Then, a contiguous set of 
nodes is defined as the source nodes. Since the contour is closed, it does not really matter 
which nodes are defined as source nodes as long as they cut the search space like a sector. 
Their neighbors on one side are also defined as the sink nodes (see block 202). 
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The present system runs Dijkstra's algorithm to find the minimum cost path between 
the "pseudo" source node and the sink nodes. This generates a contour, but nothing in the 
algorithm guarantees that it is closed, and most of the time, it is not (see block 204). 

So another set of source and sink points in the same search space is defined. The 
source node is uniquely defined as the mid-point of the previously recovered contour. The 
sink nodes are its neighbors on one side (see block 206) and Dijkstra's algorithm is called 
again. The recovered contour is guaranteed to be closed since the source and sink nodes are 
defined to be connected (see block 208). 

In the case of the heart left ventricle, both contours are segmented independently. For 
the endocardium, the cost of a link between two nodes is defined as: 
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For the epicardium, it is defined as: 
1 



e 2(/>l>/> 2 ) = 
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Here, ||V/|| is the gradient magnitude and V/ is the gradient direction in the image, e 
is a small constant to bound the energy function. In this case, the contour is built clockwise 
by the Dijkstra process and the image gradient points from bright to dark. By testing whether 
the sign of the z component of the cross product between the image gradient and the eontour 
direction is positive, and setting the energy to a large number otherwise, the contour is forced 

to separate a bright region inside from a dark region outside. 
Stage 3: 3D Hybrid Model Fit 

The initial approximation is fit to the object structure provided by the user in Stage 1 
to the sampled segmented data garnered from Stage 2 (FIG. 10, 170). The method employed 
is an iterative closest point method based on the physically-motivated recovery paradigm. In 
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this paradigm, data points are thought of as exerting forces attracting the model towards 
them. A hybrid model is capable of rigid, parametric and local (spline-like) deformations. 
Local deformations may include a deformation penalty which serves to smooth the data. 
Finite element model (FEM) shape functions are used to distribute the data forces from 
element surfaces to element nodes. Both the data forces and smoothing forces are scaled, and 
the data forces are combined with the smoothing forces. The rigid and parametric fitting is 
discontinued once the local deformations are initiated. The result is shown in FIG. 10, 180. 

Typically, in hybrid model recovery rigid body characteristics (translation and 
rotation) are adjusted until they settle. Then, rigid body characteristics and the parametric 
component are fit. And, once they settle, the rigid body characteristics, the parametric 
component and the local component are fit. The present method is different from this 
standard scheme by freezing the rigid body characteristics and parametric component during 
the local model fit. The rationale is that if the parametric component is to provide a gross 
description of the data it should arrive at the same result irrespective of the presence of a 
local component. In addition, freezing the rigid body characteristics and parametric 
component during the local model fit, speeds the fitting process significantly. 

Experimental Results: 

The technique was tested on a volunteer data set with two phases of the cardiac cycle, 
En-diastole (ED) and en-systole (ES). The blood pool volume for ED was 271ml with a 
myocardial volume of 275 ml. For ES, the blood volume was 231ml with a myocardial 
volume of 285 ml. The ejection fraction for the volunteer was 14%. 

While certain embodiments have been shown and described, it is distinctly understood 
that the invention is not limited thereto but may be otherwise embodied within the scope of 
the appended claims. 
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CLAIMS 

1. A method of modeling a three dimensional target object represented by a plurality of cross- 
sectional images to provide a representative corresponding three dimensional model, 
comprising the steps of: 

selecting an initial model from a plurality of available initial models by 
ide ntifying a n initial model based on physical similarity to said target object; 

superimposing an initial model upon said target object; 

for each of said plurality of cross-sectional images, 

determining an intersection contour of said initial model and a 
cross-sectional image of said target object; 

refining said determined intersection contour to more closely 

delineate said target object; 

sub-sampling points representing said refined determined 
intersection contour to provide a sub-sampled contour dataset; and 

adjusting said initial model towards said sub-sampled contour 
to provide a representative three dimensional model of said target object. 

2. A method according to claim 1 wherein said step of refining said determined 
intersection contour includes the step of 

processing image data points representing said determined intersection 
contour to provide points representing a contour more closely delineating said target object. 

3. A method according to claim 1 for providing a representative corresponding three 
dimensional model for a three dimensional target object varying in shape between different 
operational phases, including the step of 

repeating the steps of claim 1 for different shapes of said target object 
for corresponding different operational phases. 
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4. A method according to claim 3 wherein said different operational phases comprise 
at least one of (a) different phases of heart operation, (b) different movement phases of a 
skeletal structure, (c) different states of an anatomical organ. 

5. A method according to claim 1 wherein said data set represents three dimensions. 

6. A method according to claim 1 including the step of 

employing a scale factor to weight data locations from said sub-sampled 
contour dataset in refining said determined intersection contour to more closely delineate said 
target object. 

7. A method according to claim 1 including the step of 

selecting an initial model from a plurality of available initial models by 
identifying an initial model based on physical similarity to said target object. 

8. A method according to claim 1 wherein 

said method of claim 1 is performed automatically for a target object without 
User entry of data. 

9. In an image processing system, a method of modeling a three dimensional target 
object, varying in shape between different operational phases and represented by a plurality 
of cross-sectional images, to provide a representative corresponding three dimensional model, 
comprising the steps of: 

for a first shape of said target object, 

superimposing an initial model upon said target object; 
for each of said plurality of cross-sectional images, 

determining an intersection contour of said initial model and a 
cross-sectional image of said target object; 

refining said determined intersection contour to more closely 
delineate said target object; and 
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adjusting said initial model towards said refined determined 
intersection contour to provide a representative three dimensional model of said target object; 
and 

for a second shape of said target object, 
repeating the previous steps. 

10. A method according to claim 8 including the step of 

selecting said initial model from a plurality of available initial models by 
identifying an initial model most closely fitting said target object. 

1 1. A method according to claim 10, including the step of 

identifying said initial model most closely fitting said target object by 
positioning and rotating an image representing said initial model to most closely align with an 
image representing said target object. 

12. A method according to claim 9 wherein said step of refining said determined 
intersection contour includes the step of 

applying image processing functions to image data points representing said 
determined intersection contour to provide points representing a contour more closely 
delineating said target object. 

1 3 . A method according to claim 9 including the step of 

employing said representative three dimensional model of (a) said target 
object first shape and (b) said target object second shape, in determining at least one of, (i) 
volume difference between said first and second shapes, (ii) strain on said target object and 
(Hi) a suitable replacement for said target object. 

14. A method according to claim 9 wherein 

said three dimensional target object varies in shape, between said first shape 
and said second shape associated with corresponding operational phases, on a substantially 
periodic basis. 
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15. In an image processing system, a method of modeling a three dimensional target 
object, varying in shape between different operational phases and represented by a plurality 
of cross-sectional images, to provide a representative corresponding three dimensional model, 
comprising the steps of: 

for a first shape of said target object, 

superimposing an initial model upon said target object; 
for each of said plurality of cross-sectional images, 

determining an intersection contour of said initial model and a 
cross-sectional image of said target object; 

refining said determined intersection contour to more closely 

delineate said target object; 

sub-sampling points representing said refined determined 
intersection contour to provide a sub-sampled contour dataset; and 

adjusting said initial model towards said sub-sampled contour 
to provide a representative three dimensional model of said target object; and 
for a second shape of said target object, 
repeating the previous steps. 

1 6. A method according to claim 1 5 including the step of 

employing said representative three dimensional model of (a) said target 
object first shape and (b) said target object second shape, in determining at least one of, (i) 
volume difference between said first and second shapes, (ii) strain on said target object and 
(iii) a suitable replacement for said target object. 

17. A method according to claim 15 including the step of 

selecting an initial model from a plurality of available initial models by 
identifying an initial model based on physical similarity to said target object. 
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